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TOs  report  identifies  issues  that  we  believe  merit  closer  attention  as 

SSnTh  of  Defense  (dod)  seek  to  resolve  concerns 

elating  to  the  management  and  use  of  dod’s  federally  funded  research  and 
development  centers  (ffrdc).  We  also  discuss  information  from , 

March  1996  testimony  on  recent  dod  actions  to  i 
of  FFRDCS.* 


1  our 

'  improve  the  management 


Background 


FFRDCs  were  first  estabhshed  during  World  War  II  to  meet  specialized  or 
^que  research  and  development  needs  that  could  not  be  readily  satisfied 
by  government  personnel  (due  to  limits  on  federal  salaries  and  iLi^or 
commerci^  contractors.  Additional  and  expanded  requirements  for 
specialized  services  led  to  mcreases  not  only  in  the  size  but  also  in  the 
number  of  ffrdcs,  which  peaked  at  74  in  1969.  Today  8  agencies 
mcluding  DOD,  fund  39  ffrdcs  that  are  operated  by  universities,  nonprofit 

rtl?  under  long-term  contracts.  Provisions  of 

mnt™  T  Contracting  Act^  authorize  agencies  to  award  these 

contracts  noncompetitively.  The  Office  of  Federal  Procurement  Policy 
(OFPP)  withm  the  Office  of  Management  and  Budget  (omb)  establishes 
govemmentwide  policy  on  the  use  and  management  of  fefidcs 

^e  Director  of  Defense  Research  and  Engineering  is  responsible  for 

th  Director  also  determines 

^  congressional  ceiling 

™  '«l“iremente.  Planned  flscfl 

year  1996  fundmg  for  dod  s  ffrdcs  is  about  $1.2  billion,  dod  categorizes 

Stadief  ^dlna^  ^  ^  engineering  and  integration  center,  a 

studies  and  analyses  center,  or  a  research  and  development  laboratoiy 


^See  10  U.S.C.  2304  (b)(1)(C)  and  (c)(3)(B). 
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The  miUtaiy  services  and  defense  agencies  sponsor  individual  centers  and 
award  and  administer  5-year  contracts  after  reviewing  the  contmued  need 
for  the  FEUDCs.  Unlike  a  commercial  contractor,  an  ffrdc  accepts 
restrictior»on  its  ability  to  manufacture  products  and  compete  for  other 
government  or  commercial  business.  These  restrictions  are  mtended  to 
f  n  limit  the  potential  for  conflicts  of  interest  when  ffrdc  staff  have  access 
to  sensitive  government  or  contractor  data  and  (2)  allow  the  dod  sponsor 
to  form  and  maintain  a  special  or  strategic  relationship  with  its  ffrdc. 


As  DOD  downsizing  continues,  attention  has  turned  to  the  infrastructure 
supporting  dod’s  research  and  technology  programs,  dod  has,  for  example, 
initiated  efforts  to  consolidate  and  downsize  military-operated 
laboratories  to  eliminate  redundant  facilities.  In  line  with  heightened 
attention  accorded  dod’s  technology  infrastructure,  Congress  has  renewed 
its  long-standing  concern  over  dod’s  use  of  ffrdcs  and  undertaken  several 
initiatives  to  control  the  centers  more  tightly.  The  Department  of  Defense 
Appropriations  Act,  1995,  PubUc  Law  103-335,  prohibited  the  creation  of 
new  FFRDCS,  imposed  more  specific  restrictions  on  their  operations,  and 
limited  the  total  funding  dod  provides  such  centers.  For  ex^ple,  over^ 
funding  for  dod’s  ffrdcs,  in  constant  1995  dollars,  increased  by  about 
percent,  from  almost  $1.4  billion  in  fiscal  year  1985  to  a  peak  of 
approximately  $1.7  biUion  in  fiscal  year  1990,  after  which  Congress  began 
reducing  dod’s  ffrdc  funding.  Since  fiscal  year  1990,  funding  for  dot  s 
FFRDCS  has  decreased  by  almost  26  percent  to  about  $1.3  bfilion  ^ 
year  1995.  Figure  1  shows  the  obligations  of  dod’s  ffrdcs,  m  constant  1 
dollars,  from  fiscal  years  1985  to  1995. 
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Figure  1:  Obligations  for  DOD’s  FFRDCs  From  Fiscal  Years  1985-95  (in  Constant  1995  Dollars) 

Dollars  in  millions 


■■■I 
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ii  Systems  engineering  □  Studies  and  analyses  ■  Laboratories 


Source;  DOD. 


Results  in  Brief  of  our  work  on  FFRDCS,  as  well  as  studies  done  by  others,  we 

have  Identified  four  issues  we  believe  merit  attention  as  Congress  and  dod 
work  to  resolve  concerns  relating  to  ffrdcs.  These  issues  are  whether  dod 
(1)  hmits  Its  FFRDCS  to  performing  appropriate  work,  (2)  adequately 

objectivity  of  its  ffrdcs,  (3)  oversees  its  ffrdcs  effectively 
and  (4)  adequately  considers  cost-effective  alternatives  to  using  ffrdcs. 

Krst,  the  DOD  Inspector  General’s  office  and  others  have  raised  concerns 
that  FFRDC  mission  statements  are  too  broad  and  do  not  clearly  identify  the 
specialized  tasks  that  ffrdcs  should  perform.  An  overly  broad  charter  may 
allow  FFRDCS  to  diversify  into  areas  outside  their  proper  scope.  For 
example,  an  ffrdc  might  assume  work  that  commercial  contractors  could 
perform  as  effectively  imder  competitive  contracts.  On  the  other  hand. 
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there  is  some  debate  as  to  whether  ffrdcs  may  be  performing  inherently 
governmental  ftmctions  that  should  be  performed  by  cirfl  servants,  dod 
now  defines  the  role  of  ffrdcs  as  performing  work  that  is  consistent  with 
the  FFRDc’apurpose,  mission,  capabilities,  and  core  competencies  and 
requires  a  special  relationship  between  the  ffrdc  and  its  sponsor. 

While  DOD  states  that  it  is  important  to  ensure  that  tasks  assigned  to  the 
FFRDC  meet  the  core  work  criteria,  we  believe  it  will  continue  to  be 
difficult  to  determine  whether  a  task  meets  these  criteria.  We  found  that 
FFRDC  mission  statements  remain  broad,  and  ffrdcs’  recently  identified 
core  competencies  differ  little  from  the  previous  scope  of  work 
descriptions.  As  we  stated  in  our  1988  report,  the  need  for  the  special 
relationship  is  the  key  to  determining  whether  a  task  is  appropriate  for  an 
FFRDC.®  However,  determining  whether  one  or  more  of  the  characteristics 
of  the  special  relationship  is  required  for  a  task  may  be  difficult,  since 
determining  the  need  for  an  element  of  the  special  relationship  requires 
potentially  difficult  and  subjective  judgments. 

Second,  questions  have  been  raised  by  Congress  and  others  about  whether 
DOD  efforts  to  safeguard  the  objectivity^  of  its  ffrdcs  are  adequate. 
Specifically,  these  questions  have  been  raised  because  dod  (1)  has  issued 
little  specific  FFRDC-wide  guidance  on  safeguarding  objectivity  or 
regulating  the  outside  interests  of  Board  of  Trustee  members,  relying 
instead  on  ffrdc  sponsors  to  design  appropriate  internal  controls  and 
(2)  has  not  historically  exerted  strong  control  over  work  ffrdcs’  parent 
organizations  perform  through  non-FFRDC  divisions.  'The  ability  to  give 
impartial,  objective  advice  is  a  key  characteristic  of  dod’s  special 
relationship  with  ffrdcs  and  is  fundamental  to  the  value  dod  attaches  to 
their  use.  dod  believes  the  risk  of  abuse  is  low  and  generally  relies  on  its 
sponsors  to  design  appropriate  safeguards.  We  found  that  some  sponsors 
have  implemented  more  rigorous  controls  than  others.  Further,  we  found 
that  FFRDC  trustees  had  a  broad  network  of  affiliations  Avith  private 
industry,  universities,  and  government.  As  the  Department  of  Defense 
Appropriations  Act,  1992,  Public  Law  102-172,  directed,  dod  now  requires 
an  approved  conflict-of-interest  poUcy  for  ffrdc  trustees,  but  rather  than 
establishing  departmentwide  criteria,  dod  relies  on  sponsors  to  design 
appropriate  internal  controls. 


3r.omiiRtit.ion:  Issues  on  EstabUshing  and  Using  Federally  Funded  Research  and  Development  Center 
(GAO/NSIAD-88-22,  Mar.  7, 198S). 


^Objectivity  in  this  context  is  generally  nnderstood  to  mean  the  abiUty  to  protade  technical  and 
analytical  support  that  is  unbiased,  impartial,  free  from  real  or  perceived  conflicts  of  mterest,  and 


solely  in  the  public  interest. 
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Likewise,  dod  not  historically  exerted  strong  control  over  work  ffrdcs’ 
parent  organizations  perform  through  non-FFRDC  divisions.  The  question  of 
whether  accepting  work  from  organizations  other  than  its  sponsor  impairs 
^  FFRDC  s  ability  to  provide  objective  advice  has  long  been  discussed  dod 
has  revised  its  ffrdc  management  plan  to  incorporate  criteria  to  limit 
diversification  by  ffrdc  parent  corporations  and  control  the  non-FFRDC 
work  they  perform.  The  ultimate  effectiveness  of  the  criteria  in  alleviating 
concerns  about  parent  corporations’  diversification  wfil  depend  largely  on 
the  quality  and  thoroughness  of  sponsor  reviews  of  proposed  non-FFRDC 


TWrd,  Congress  and  others  have  repeatedly  raised  questions  about  the 
adequacy  of  dod  policy  guidance  and  oversight.  Concerns  have  been  raised 
regardmg  whether  dod  policy  guidance  ensures  that  sponsors 
(1)  adequately  justify  awarding  noncompetitive  contracts  for  the  operation 
of  the  FFRDCS,  (2)  adequately  screen  tasks  assigned  to  ffrdcs, 

(3)  implement  adequate  audit  controls  for  the  ffrdcs,  (4)  award 
reasonable  coritract  fees,  and  (6)  make  certain  that  ffrdc  employees’ 
compensation  is  reasonable.  For  example,  concerns  remain  as  to  whether 
dod  sponsors  adequately  justify  the  continuing  need  for  the  ffrdcs.  Under 
federal  policy,  an  agency  may  continue  sponsorship  of  an  ffrdc  and  award 
a  noncompetitive  contract  for  its  operation  only  after  demonstrating  a 
contmmng  need  for  the  center.  We  found  that  recently  completed  reviews 
to  ji^tify  the  contmmng  need  for  ffrdcs  generally  contained  extensive 
analyses  and  discussion  and  addressed  the  criteria  required  by  dod.  These 
reviews,  however,  did  not  include  formal  market  surveys  to  identify 
alternatives  to  using  ffrdcs.  Similarly,  we  and  others  have  raised  recurring 
questrons  about  how  ffrdcs  use  their  contract  fees.  Our  recent  work  at 
The  Aerospace  Corporation  and  the  MI'TRE  Corporation  found  that  these 
two  organizations  used  contract  fees  to  pay  costs  for  items  such  as 
entertainment,  personal  expenses  for  company  officers,  and  employee 


While  DOD  has  taken  some  steps  to  address  the  concerns  regarding 
oversrght,  a  Defense  Science  Board  (dsb)  Task  Force  recently  noted  a 
sigmficant  distrust  of  dod’s  use  and  management  of  its  ffrdcs  and 
recommended  the  establishment  of  an  independent  advisory  panel  to 
address  this  distrust.®  This  panel  was  established  in  late  1995  with  the 
rmssion  of  reviewing  and  advising  dod  on  the  management  of  its  ffrdcs. 
Uunng  meetings  earlier  this  year,  we  observed  that  the  panel  members 
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appeared  to  be  approaching  their  task  Avith  the  utmost  seriousness  and 
asking  toT#i  questions  of  both  dod  and  ffrdc  officials. 

Fourth,  concerns  have  long  been  expressed  that  dod  does  not  adequately 
consider  hiring  civil  servants  or  contracting  with  commercial  firms  as 
alternatives  to  using  ffrdcs.  dod  maintains  that  in-house  and  commercial 
contractor  alternatives  to  the  centers  are  not  as  effective.  While  limits  on 
hiring  additional  civil  servants  make  in-house  alternatives  difficult  to 
pursue,  we  concluded  in  1994  that  managers  should  be  required  to  analyze 
the  relative  cost  of  performing  a  function  both  by  contract  and  in-house 
when  deciding  to  contract  for  services.®  A  1991  Air  Force  initiative,  known 
as  Coral  Convert,  Ulustrates  the  potential  benefits  of  such  analyses, 
projecting  $17.9  miUion  in  annual  savings  by  using  civfi  servants  to  replace 
FFRDC  and  service  support  contractor  personnel.'^  Similarly,  the  complexity 
of  awarding  competitive  contracts  to  commercial  firms  may  create 
incentives  to  use  ffrdcs  without  adequately  examining  competitive 
alternatives.  We  identified  two  alternatives— using  broad  agency 
annoimcements®  to  obtain  information  on  the  capabilities  of  non-FFRDCs, 
or  using  procedures  for  the  award  of  task  order  contracts  for  advisory  and 
assistance  services  that  were  authorized  under  the  Federal  Acquisition 
Streamlining  Act  of  1994  Public  Law  103-355— which  could  alleviate  some 
of  the  administrative  burdens  of  competitive  contracting. 

In  our  March  1996  testimony,  we  reported  that  dod  had  recently  provided 
an  update  on  initiatives  it  was  taking  to  (1)  define  ffrdc  core  work 
appropriate  for  ffrdcs,  (2)  establish  stringent  criteria  for  the  noncore 
work  ffrdcs’  parent  corporations  accept,  (3)  develop  ^defines  to  ensure 
that  management  fees  are  based  on  need  and  detailed  justification,  and 
(4)  establish  an  independent  advisory  panel  as  the  dsb  Task  Force 
recommended.  We  generally  support  the  direction  dod  has  taken  with 
these  initiatives  to  address  long-standing  issues  related  to  management  of 
FFRDCS.  Because  the  initiatives  are  just  now  being  implemented,  it  is  too 


‘^Government  Contractors:  Contracting  Out  Implications  of  Streamlining  Agency  Operations 
(GAO/T-GGD-954,  Oct  5, 1994 J. 


^In  1991,  the  Air  Force  Materiel  Command  (AFMC)  proposed  hiring  ci^  se^ts  to  repine  ce^m 
contractor  personnel  at  its  Electronic  Systems  Center  and  Space  and  Missile  Systems  Center.  In  a 
limited  test^of  this  proposal,  AFMC  successfully  recruited  qualified  personnel  for  civil  service 
Dositions  and  officials  reported  that  cost  savings  were  being  achieved.  The  test  was  not  expanded, 
Lwever,’  due  to  federal  workforce  reductions  imposed  after  the  National  Performance  Review  repo  . 


8The  Federal  Acquisition  Regulation  6.102  (d)(2)(i)  provides  that  a  broad  agency  ^  “ 

general  announcement  of  an  agency’s  research  interest,  including  cntena  for  selecting  proposals,  and 
Eliciting  the  participation  of  all  offerors  capable  of  satisfying  the  government  s  needs. 
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early  to  tell  how  effectively  they  will  be  implemented  or  how  well  they  will 
address  long-standing  concerns  regarding  use  of  ffrdcs. 

Agency  Comments 

DOD  generally  concurred  with  this  report  (see  app.  V).  dod  also  provided 
some  technical  comments  and  suggested  clarifications  that  have  been 
incorporated  into  the  report  as  appropriate. 

im — - - 

Scope  and 
Methodology 

Our  review  mcluded  the  11  ffrdcs  dod  sponsors.  We  did  not  include  dod’s 
umyersity-affiliated  research  centers  in  our  review,  since  dod’s  internal 
reviews  of  ffrdc  issues  did  not  include  these  centers  until  May  1995,  and 
the  studies  on  which  we  relied  did  not  include  information  on  the 
university-affiliated  centers.^ 

We  based  this  review  on  our  work  related  to  pfrdcs  as  well  as  reports  and 
studies  done  by  others.  We  supplemented  this  information  with  limited 
additional  data  coUection  to  provide  up-to-date  information  on  dod 
activities.  We  did  not  attempt  to  provide  definitive  answers  to  policy 
questions  or  recommendations  for  resolving  the  issues.  We  obtained 
information  from  documents,  reports,  and  interviews  with  officials  from 
the  Office  of  the  Director  of  Defense  Research  and  Engineering,  Defense 
Contract  Audit  Agency,  selected  ffrdcs  and  their  sponsors,  and  omb.  We 
also  mterviewed  officials  firom  Johns  Hopkins  University’s  Applied  Physics 
Laboratory— currently  a  university-affiliated  research  center  that  had  been 
an  ^RDC  until  the  mid-1970s — and  the  Professional  Services  Coimcil.^®  We 
reviewed  legislation  and  federal  regulations  pertaining  to  ffrdcs  and 
reviewed  prior  reports  by  dod,  the  dsb  Task  Force,  Senate  Governmental 
Affairs  Committee,  Congressional  Research  Service,  Office  of  Technology 
Assessment,  and  our  office.  We  conducted  our  review  between  October 
1994  and  May  1996  in  accordance  with  generally  accepted  government 
auditing  standards. 


Appendix  I  provides  additional  details  on  the  issues  discussed  above 
relating  to  the  management  of  DOD-sponsored  ffrdcs,  and  appendix  n  lists 
the  reports  issued  by  us  and  others  relating  to  dod’s  ffrdcs.  Appendix  HI 
includes  general  information  on  dod’s  ffrdcs,  and  appendix  IV  compares 


SS  uruversity-affiliated  research  centers  when 

reviewing  FFRDCs  due  to  the  similar  manner  m  which  the  organizations  function. 

Services  Council  is  a  trade  association  representing  commercial  professional 
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the  FFRDCs’  former  scope  of  work  descriptions  and  their  recently  identified 
core  competencies.  Appendix  V  contains  comments  fi*om  dod. 

We  are  providing  copies  of  this  report  to  the  Secretary  of  Defense, 
Administrator  of  ofpp,  and  other  interested  congressional  committees  and 
subcommittees.  Copies  will  also  be  made  available  to  others  on  request. 

Please  contact  me  at  (202)  512-4587  if  you  or  your  staff  have  ^y  questions 
concerning  this  report.  Major  contributors  to  this  report  are  listed  in 
appendix  VI. 


David  E.  Cooper 
Associate  Director, 

Defense  Acquisitions  Issues 
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Appendix  I _ _ _ _ _ _ _ 

Issues  Relating  to  the  Management  of 
DOD-Sponsored  FFRDCs 


This  appendix  discusses  issues  that  we  believe  merit  attention  as  Congress 
and  the  Department  of  Defense  (dod)  work  to  resolve  concerns  relating  to 
federally  fended  research  and  development  centers  (ffrdc),  including  the 
(1)  missions  and  core  functions  of  ffrdcs,  (2)  safeguards  for  ffrdc 
objectivity,  (3)  dod  oversight  of  the  centers,  and  (4)  alternatives  to  using 
the  centers.  This  appendix  also  discusses  information  from  our 
March  1996  testimony  on  recent  dod  actions  to  improve  the  management 
of  FFRDCS. 


The  Missions  and 
Core  Functions  of 
DOD’s  FFRDCs 


The  DOD  Inspector  General’s  office,  among  others,  has  raised  concerns  that 
FFRDC  mission  statements  are  too  broad  and  do  not  clearly  identify 
specialized  tasks  that  the  ffrdc  can  perform  most  effectively.  The  mission 
statement  of  the  Lincoln  Laboratory  ffrdc,  for  example,  states  that  the 
Laboratory  is  to  “carry  out  a  program  of  research  and  development 
pertinent  to  national  defense. . . There  has  been  some  concern  within 
Congress  and  among  others  that  ffrdcs  may  be  diversifying  into  areas 
outside  their  proper  scope,  dod,  however,  now  defines  the  role  of  ffrdcs 
as  performing  work  that  is  consistent  with  the  ffrdc’s  purpose,  mission, 
capabilities,  and  core  competencies  and  requires  a  special  relationship  to 
exist  between  the  ffrdc  and  its  sponsor.  Such  work  need  not  require 
unique  capabilities.  Using  the  special  relationship  to  identify  work 
appropriate  for  the  ffrdcs  will  require  potentially  difficult  and  subjective 
judgments  to  determine  whether  a  task  is  appropriate  for  an  ffrdc  to 
perform.  Further,  there  is  some  debate  that  the  ffrdcs  may  perform 
inherently  governmental  functions  that  government  employees  should 
perform. 


Role  of  FFRDCs  Is  Defined 
in  Terms  of  Special 
Relationship  Rather  Than 
Unique  Capabilities 


As  a  robust  private  sector  professional  services  industiy  grew  to  meet  the 
demand  for  technical  services,  it  became  apparent  that  industry  had  the 
capability  to  perform  some  tasks  assigned  to  ffrdcs.  As  early  as  1962,  the 
Bell  Report  noted  criticism  that  nonprofit  systems  engineering  contractors 
had  undertaken  work  traditionally  done  by  private  firms.‘  A  1971  dod 
report  stated,  “It  is  pointless  to  say  that  the  [systems  engineering  ffrdc] 
function  could  not  be  provided  by  another  instrumentalify. . . .”  According 
to  this  report,  private  contractors  could  also  do  much  the  same  type  of 
work  as  the  studies  and  analyses  of  ffrdcs.  The  report  pointed  to  the 
flexibility  of  using  the  centers  and  their  broad  experience  with  sponsors’ 
problems  as  reasons  for  continuing  their  use.  In  1994,  the  dod  Inspector 
General  concluded  that  ffrdc  mission  statements  did  not  identify  unique 


'Complete  citations  for  all  references  to  specific  reports  and  studies  are  provided  in  app.  II. 
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capabilities  or  expertise,  resulting  in  ffrdcs  being  assigned  work  without 
adequate  justification. 


In  a  1988  report,  we  pointed  out  that  govemmentwide  policy  did  not 
require  that  ffrdcs  be  limited  to  work  that  industry  could  not  do;  ffrdcs 
could  also  undertake  tasks  they  could  perform  more  effectively  than 
industry,  ffrdcs  are  effective,  we  observed,  partly  because  of  their  special 
relationship  with  their  sponsoring  agency.  This  special  relationship 
embodies  elements  of  access  and  privilege  as  well  as  constraints  to  limit 
their  activities  to  those  dod  deems  appropriate. 


DOD  has  recently  elaborated  on  and  refined  the  concept  of  the  ffrdc 
special  relationship.  According  to  dod,  ffrdcs  perform  tasks  that  require  a 
special  or  strategic  relationship  to  exist  between  the  task  sponsor  and  the 
organization  performing  the  task.  Table  1.1  shows  dod’s  description  of  the 
characteristics  of  this  special  relationship.  According  to  the  Defense 
Science  Board  (dsb)  Task  Force,  these  characteristics  allow  an  ffrdc  to 
perform  research,  development,  and  analytical  tasks  that  are  integral  to 
the  mission  and  operation  of  the  sponsor. 


Table  1.1 :  Characteristics  of  the  Special 
Relationship  Between  an  FFRDC  and 
Its  DOD  Sponsor 


Characteristic 

Description 

Long-term  continuity. 

Uninterrupted,  consistent  support  based 
on  a  continuing  relationship. 

Comprehensive  knowledge  of  sponsor 
needs  and  operations. 

Expertise  on  and  Institutional  memory 
about  Issues  of  enduring  concern  to  the 
sponsor. 

Adaptability. 

Ability  to  respond  to  emerging  needs  of 
their  sponsors. 

Objective,  high-quality,  current  research. 

A  highly  educated  and  skilled  professional 
staff  that  can  produce  thorough, 
independent  analyses  to  address  complex 
technical  and  analytical  problems  and 
maintain  currency  In  their  fields  of 
expertise. 

Freedom  from  real  or  perceived  conflicts  of 
interest. 

Independence  of  commercial, 
shareholder,  political,  and  other 
associations  and  dedication  to  the  public 
interest. 

Broad  access  to  sensitive  government  and 
commercial  proprietary  information. 

Lack  of  institutional  interests  that  could 
lead  to  misuse  of  information  or  cause 
contractor  reluctance  to  provide  such 
information. 

Quick  response  capability. 

Short-term  assistance  to  help  sponsors 
meet  urgent  and  high-priority  reguirements 
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DOD  Seeks  to  More 
Clearly  Identify  Work  to  Be 
Performed  by  FFRDCs 


In  1995,  the  DSB  Task  Force  and  an  internal  dod  advisory  group  concluded 
that  there  is  a  continuing  need  for  ffrdcs  for  certain  core  work  that 
requires  tiie  special  relationship  previously  described.  Giving  such  tasks  to 
commercial  contractors,  dod  concluded,  would  raise  numerous  concerns, 
including  questions  about  potential  conflicts  of  interest.  Accordingly,  dod 
has  defined  an  ffrdc’s  core  work  effort  as  tasks  that  (1)  are  consistent 
with  the  ffrdc’s  purpose,  mission,  capabilities,  and  core  competencies  and 
(2)  require  the  ffrdc’s  special  relationship  with  its  sponsor.  'The  dod 
advisory  group  estimated  that  this  core  work  effort  represents  about 
3.4  percent  of  dod’s  research,  development,  and  analytic  effort.  The  Task 
Force  and  advisory  group  also  found  that  ffrdcs  performed  some  noncore 
work  that  did  not  require  a  special  relationship  and  concluded  that  ^s 
work  should  be  transitioned  out  of  the  ffrdcs  and  acquired  competitively. 


On  the  basis  of  these  conclusions,  dod  required  each  sponsor  to  review  its 
ffrdc’s  core  competencies,  identify  and  prioritize  the  ffrdc’s  core  work 
effort,  and  identify  the  noncore  work  that  should  be  transitioned  out  of  the 
FFRDC.  We  foxmd,  however,  that  the  core  competencies  the  sponsors 
identified  differed  little  fi-om  the  scope  of  work  descriptions  that  were  in 
place  previously  (see  app.  IV).  In  several  cases,  the  core  competencies 
simply  restated  the  functions  listed  in  an  ffrdc  s  scope  of  work 
description.  In  others,  the  core  competencies  summarized  the  scope  of 
work  functions  into  more  generic  categories.  'The  sponsors  we  spoke  to 
told  us  they  identified  little,  if  any,  noncore  work  being  performed  at  their 
ffrdcs. 

Even  though  dod  states  that  it  is  important  to  ensure  that  tasks  assigned  to 
the  FFRDC  meet  the  core  work  criteria,  we  believe  it  will  continue  to  be 
difficult  to  determine  whether  a  task  meets  these  criteria,  ffrdc  mission 
statements  remain  broad,  and  core  competencies  differ  little  fi*om  the 
previous  scope  of  work  descriptions.  As  we  stated  in  our  1988  report,  the 
need  for  the  special  relationship  is  the  key  to  determining  whether  work  is 
appropriate  for  an  ffrdc.  However,  determining  whether  one  or  more  of 
the  characteristics  of  the  special  relationship  is  required  for  a  task  may  be 
difficult,  since  the  need  for  an  element  of  the  special  relationship  is 
normally  relative  rather  than  absolute.  For  example,  we  believe  dod  would 
expect  objectivity  in  any  research  effort,  but  it  may  be  difficult  to 
demoiistrate  that  a  particular  task  requires  the  special  degree  of 
objectivity  an  ffrdc  is  believed  to  provide. 

Uncertainty  about  whether  an  ffrdc’s  special  relationship  allows  it  to 
perform  a  task  more  effectively  than  other  organizations  also  accompames 
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decisions  to  assign  work  to  an  ffrdc.  In  our  1988  report,  we  stated  that  fidl 
and  open  competition  between  ffrdcs  and  non-FPRocs  could  provide  dod 
assurance  that  it  has  selected  the  most  effective  source  for  the  work. 
However,  the  report  also  stated  that  exposing  ffrdcs  to  marketplace 

competition  would  fundamentally  alter  the  character  of  the  special 
relationship. 


FFRDC’s  Role  in 
Supporting  Governmental 
Functions  Should  Be 
Closely  Monitored 


There  is  some  debate  that  ffrdcs  may  perform  some  inherently 
governmental  functions.^  We  believe  this  concern  arises  in  part  as  a  result 
of  the  difficulty  in  clearly  distinguishing  work  that  should  be  performed  by 
ffrdcs.  dod  officials  believe  that  it  is  clear  that  the  ffrdcs  are  not 
performing  inherently  governmental  functions  but  are  performing  work 
that  supports  such  functions.  Because  of  both  the  nature  of  the  functions 
ffrdcs  perform  and  the  nature  of  the  special  relationship  between  an 
FFRDC  and  rts  sponsor,  we  believe  that  dod  needs  to  devote  continuing 
management  attention  to  ensuring  that  inherently  governmental  functions 
are  not  tasked  to  the  ffrdcs. 


On  the  b^is  of  a  review  of  agency  use  of  advisory  contractors,  we 
reported  in  1991  that  defining  inherently  governmental  functions  was 
difficult  and  subject  to  substantial  judgment.  We  concluded  that 
examining  the  nature  of  the  relationship  between  the  government  and  an 
advisory  contractor  was  more  useful  than  developing  a  specific  list  of 
functions  that  are  inherently  governmental.  Further,  we  stated  that 
government  officials  must  retain  final  authority  to  decide  government 
policy  as  well  as  maintain  an  active  role  in  the  decision-making  process  to 
allow  officials  to  make  independent  judgments  regarding  a  contractor’s 
policy  recommendations,  ofpp’s  1992  policy  statement  on  inherently 
governmental  functions  endorses  this  conclusion,  stating  that  when 
service  contractors  are  used,  government  action  must  be  “taken  as  the 
result  of  informed,  independent  judgments  made  by  Government  officials 
who  are  ultimately  accountable  to  the  President.” 


While  DOD  officials  believe  that  the  ffrdcs  are  not  performing  inherently 
governmental  functions,  they  clearly  perform  functions  that  federal 
officials  should  monitor  closely,  ofpp’s  policy  statement  includes  a  list  of 
functions  for  which  agencies  must  devote  additional  management 
attention  regarding  the  contractor  s  manner  of  performance,  ofpp  does  not 
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classify  th^  functions  as  inherently  governmental  but  requires  additional 
managemait  attention  for  them  so  as  to  ensure  that  appropriate  agency 
control  B  maintained,  ffrdcs  routinely  perform  several  of  these  functions, 
includingAe  following: 

services  that  relate  to  analyses,  feasibility  studies,  and  strategy  options  to 

be  used  by  agency  personnel  in  developing  policy; 

services  in  support  of  acquisition  planning; 

technical  evaluation  of  contract  proposals; 

assistance  in  developing  statements  of  work;  and 

work  in  situations  that  permit  access  to  sensitive  government  or 

proprietary  information. 

We  believe  that  in  addition  to  closely  monitoring  ffrdcs’  performance  of 
such  functions,  dod  should  closely  moiutor  the  assignment  of  work  to 
FFRDCS  to  ensure  that  contracting  out  for  such  services  is  appropriate. 
Although  the  special  relationship  between  an  ffrdc  and  its  sponsor  is  an 
important  criterion  for  assigning  work  to  the  fftidcs,  certain 
characteristics  of  the  special  relationship  can  raise  questions  about 
whether  functions  performed  by  ffrdcs  should  be  performed  in-house. 

Our  1991  report  on  whether  service  contractors  are  performing  inherently 
governmental  functions  proposed  guidelines  to  help  agencies  in 
determining  whether  contracting  out  for  consulting  services  would  be 
appropriate.  The  guidelines  do  not  specify  which  functions  are 
governmental,  but  address,  among  other  things,  the  nature  of  the 
relationship  between  a  government  agency  and  a  prospective  contractor 
as  aspects  for  consideration  in  contracting  out  for  services.  For  example, 
while  these  guidelines  suggest  that  government  officials  must  set  a  defimte 
time  period  for  the  use  of  a  contractor  and  use  government  employees  if 
the  need  is  for  a  long  or  indefinite  period,  an  ffrdc  is  expected  to  have  a 
long-term,  continuing  relationship  with  its  sponsor.  Similarly,  while  the 
guidelines  suggest  that  the  institutional  memory  about  agency  programs 
must  reside  with  the  agency  rather  than  the  contractor,  the  ffrdc  is 
expected  to  maintain  program  institutional  memory  for  the  sponsor.  In 
this  regard,  we  believe  the  guidelines  are  appropriate  for  use  by  dod  when 
it  considers  whether  to  contract  out  for  ffrdcs’  services  or  perform  these 
services  in-house. 
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Safeguards  for 
FFRDC  Objectivity 


According  to  dod,  the  ability  to  give  impartial,  objective  advice  is  a  key 
characteristic  of  the  special  relationship  and  is  fundamental  to  the  value 
DOD  attaches  to  the  use  of  ffrdcs.  dod  believes  the  risk  of  abuse  is  low  and 
generally  relies  on  sponsors  to  identify  and  report  or  avoid  potential 
conflicts  of  interest  and  to  design  appropriate  internal  controls.  Some 
sponsors  have  seen  a  need  to  implement  more  rigorous  controls  than 
others.^  Similarly,  dod  has  not  historically  exerted  strong  control  over  work 
FFRDCS  parent  orgamzations  performed  through  non-FFRDC  divisions.  The 
question  of  whether  accepting  work  from  organizations  other  than  its 
sponsor  impairs  an  ffrdc’s  ability  to  provide  objective  advice  has  long 
been  discussed.  Finally,  as  Congress  directed  (P.L.  102-172),  dod  has 
implemented  controls  over  ffrdc  trustees’  affiliations  with  defense 
contractors,  dod’s  approach  to  implementing  these  controls  is  to  rely  on 
sponsors’  action  rather  than  to  establish  departmentwide  criteria. 


Controls  to  Ensure 
Objectivity  Vary 


Since  objectivity  is  a  key  characteristic  of  ffrdcs,  questions  have  been 
raised  about  whether  dod  efforts  to  safeguard  the  objectivity  of  its  ffrdcs 
are  adequate.  According  to  the  dsb  Task  Force’s  1995  report, 
DOD-sponsored  ffrdcs  are  valuable  largely  because  they  pro^de  objective 
mgh-quality  work.  The  Task  Force  reported  that  the  special  relationship 
between  ffrdcs  and  their  sponsors  allows  the  centers  to  offer  unbiased 
advice,  analyses,  and  evaluations  that  focus  on  the  public  interest  dod 
sponsors  also  identified  objectivity  as  one  of  the  more  important  aspects 
of  the  special  relationship.  Objectivity  is  particularly  important  because 
FFRDCS  help  DOD  develop  and  analyze  policy  and  strategy  options  and 
assess  alternative  technology  directions.  In  some  cases,  ffrdcs  also 
evaluate  contractors’  performance  and  participate  in  source  selections  for 
weapon  system  procurements. 


DOD  sponsors  believe  that  the  potential  for  bias  in  ffrdc  advice  is  small. 
According  to  the  dsb  Task  Force,  nonprofit  coiporations  or  universities 
operate  dod’s  ffrdcs  and  therefore  are  not  influenced  by  corporate  or 
shareholder  interests.  Further,  dod  asserts  that  ffrdcs  operate  under 
restrictions  more  stringent  than  applied  to  other  government  contractors. 
For  example,  to  prevent  an  pfrdc’s  judgment  from  being  swayed  by 
prospective  profils,  dod  prohibits  the  centers  from  undertaking  long-term 
hardware  production,  dod  also  prohibits  the  centers  from  competing  with 
commercial  firms  for  government  service  contracts.  These  restrictions, 
dod  maintains,  are  sufficient  to  allow  ffrdcs  to  provide  impartial  advice 
Accordingly,  dod  has  issued  little  specific  guidance  on  safeguarding  ffrdc 
objectivity. 
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In  the  absence  of  specific  dod  guidance,  some  sponsors  have  seen  the 
need  to  impTement,  more  rigorous  controls  to  safeguard  objectivity  than 
have  othersponsors.  For  example,  dod’s  sponsoring  agreement  with  the 
MITRE  Corporation  provides  that  MITRE  will  avoid  any  action  that  will 
place  its  personnel  in  possible  or  actual  conflict  of  interest  positions.  The 
Navy’s  agreements  with  The  CNA  Corporation  also  refer  to  ensuring 
fi-eedom  from  conflicts  of  interest  but  include  additional  controls  not 
present  in  the  agreements  between  dod  and  MITRE.  The  CNA 
Corporation’s  charter  and  bylaws  require  an  annual  conflict  of  interest 
statement  for  each  employee  and  annual  statements  of  outside  affiliations 
and  financial  interests  for  trustees,  corporate  officers,  and  senior 
managers.  Further,  in  its  Code  of  Ethics  and  Standards  of  Conduct,  The 
CNA  Corporation  warrants  that  it  should  avoid  orgamzational  conflicts  of 
interest  and  agrees  to  disclose  any  conflicts  that  it  discovers  to  the 
contracting  officer.  Also,  the  Code  states  that  if  The  CNA  Corporation 
employees  do  not  report  perceived  or  actual  conflicts  to  the  appropriate 
supervisors,  they  may  be  subject  to  disciplinary  action,  which  may  include 
termination  of  employment. 


DOD  Is  Seeking  Stronger 
Oversight  as  FFRDCs 
Diversify 


The  question  of  whether  accepting  work  from  organizations  other  than  its 
sponsor  impairs  an  ffedc’s  ability  to  provide  objective  advice  has  long 
been  discussed.  As  early  as  1962,  the  Bell  Report  raised  this  question  but 
noted  that  no  clear  consensus  had  developed  as  to  whether  concerns 
about  diversification  were  well  founded.  The  report  recogmzed  that 
studies  and  analyses  ffrdcs  could  effectively  serve  multiple  clients  but 
concluded  that  systems  engineering  organizations  were  primarily  of  value 
when  they  served  a  single  client.  Dvuing  the  early  1970s,  dod  encouraged 
its  FFRDCS  to  diversify  into  nonsponsor  work.  According  to  a  1976  dod 
report  on  the  management  of  federal  contract  research  centers,  ffrdcs 
that  did  not  diversify  suffered  efficiency  and  morale  problems  as  their 
organizations  shrank  in  the  face  of  declining  dod  research  and 
development  budgets.  Nonetheless,  this  report  recommended  that  the 
systems  engineering  ffrdcs  limit  themselves  to  dod  work  and  a(ljust  their 
workforces  in  line  with  changes  in  the  dod  budget.  Regarding  the  MITRE 
Corporation,  the  report  recommended  that  MITRE  create  a  separate 
organization  to  carry  out  its  non-DOD  work.  In  1994,  concerns  were  raised 
within  Congress  that  11\e  activities  of  non-FFRDC  organizations  resulted  m 
“an  ambiguous  legal,  regulatory,  orgamzational,  and  financial  situation, 
and  DOD  was  directed  to  prepare  a  report  on  non-FFRDC  activities  (Senate 
Report  103-282).  More  recently,  however,  the  dsb  Task  Force  concluded  in 


^FFRDCs  were  previously  called  federal  contract  research  centers. 
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its  1995  report  that  ffrdcs  and  their  parent  companies  should  be  allowed 
to  accept  work  outside  the  core  domain  only  when  doing  so  was  in  the 
best  interest  of  the  country;  the  Task  Force  did  not  propose  criteria  for 

determining  whether  accepting  nonsponsor  work  was  in  the  country’s  best 
interest. 

Acceptance  of  non-FFRoc  work  is  now  common  at  seven  of  the  eight 
parent  organizations  operating  dod’s  ffrdcs.  Except  for  the  Institute  for 
Defense  Analyses,  each  parent  organization  performs  some  non-FFRDC 
work  either  within  the  ffrdc  or  through  an  affiliated  organization  created 
to  pursue  non-FFRDC  work.  Some  affiliates  are  quite  small:  The  CNA 
Corporation’s  Institute  for  Public  Research  accounts  for  about  3  percent 
of  die  Corporation’s  total  effort.  Other  affiliates  are  more  significant:  prior 
to  its  division  in  1996,  the  MITRE  Corporation’s  two  non-FFRDC  affiliates 
accounted  for  about  11  percent  of  MITRE’s  total  effort,  and  RAND’s  five 
non-FFRDC  divisions  account  for  about  32  percent  of  RAND’s  total  effort. 
The  Massachusetts  Institute  of  Technology  and  Camegie-Mellon 
University— parent  organizations  of  Lincoln  Laboratory  and  the  Software 
Engineering  Institute,  respectively — each  pursue  a  diverse  range  of 
non-FFRDC  activities. 


DOD  has  recently  become  more  active  in  seeking  to  oversee  work  the 
parent  organizations  perform  through  non-FFRDC  divisions.  Sponsors  have 
historically  had  the  opportunity  to  oversee  nonsponsor  work  performed 
within  the  ffrdc  because  the  work  is  carried  out  under  the  ffrdc  contracts 
that  sponsors  admimster.  'This  contract  oversight  mechanism  is  not 
available  for  non-FFRDC  divisions.  During  1995,  for  example,  the  Air  Force 
expressed  great  reluctance  to  support  The  Aerospace  Corporation’s 
proposal  to  establish  a  non-FFRDC  affiliate,  indicating  its  concerns  about 
the  perception  of  a  conflict  of  interest.  Similarly,  the  MITRE  Corporation’s 
Board  of 'Trustees  decided  to  create  a  separate  corporate  division  to 
perform  non-FFRDC  work  for  government  and  commercial  customers  after 
DOD  rejected  a  MITRE  proposal  to  establish  an  affiliated  organization  to 
handle  commercial  and  non-FFRDC  work,  dod  generally  concurred  with  the 
direction  of  the  Board’s  plan  to  divide  the  corporation  and  formally 
expressed  the  Department  s  position  that  any  cost  recovery  and 
disffibution  of  assets  and  liabilities  be  legally  appropriate,  justified,  and 
subject  to  audit  by  the  Defense  Contract  Audit  Agency  (dcaa).  'This  new 
corporation  has  a  separate  Board  of  Trustees  and  its  own  corporate 
officers.  Further,  no  work  is  to  be  subcontracted  between  the  two  entities 
in  order  to  preclude  the  sharing  of  employees  involved  in  dod  work — ^and 
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FFRDC  Sponsors  Oversee 
Affiliations  of  Trustees 


knowledge  developed  in  the  course  of  dod  work— with  the  new 
coiporatiorL 


A  long-standing  concern  has  been  that  the  personal  financial  interests  and 
affiliations  of  ffrdc  trustees  may  affect  the  objectivity  of  the  advice  they 
provide  dod.  In  1962,  the  Bell  Report  noted  that  the  boards  of 
organizations  such  as  ffedcs  were  often  comprised  of  representatives  of 
universities  and  commercial  firms  involved  in  federal  research.  Although 
acknowledging  that  it  was  in  the  public  interest  to  have  such  organizations 
“controlled  by  the  most  responsible,  mature,  and  knowledgeable 
[individuals]  available  in  the  nation,”  the  report  pointed  to  the  clear 
possibility  that  the  potential  for  conflicts  of  interest  inherent  in  such 
interlocking  directorships  could  harm  the  public  interest.  The  report 
concluded  that  ffrdc  trustees  should  observe  the  spirit  of  recently 
adopted  government  policy  concerning  government  consultants  and 
advisers.  This  policy  required  consultants  and  advisers  to  fully  disclose 
their  private  interests  and  abstain  from  rendering  advice  on  matters  that 
would  affect  their  private  interests. 

FFRDC  trustees  have  a  broad  network  of  affiliations.  Our  1995  report  on  the 
affiliations  of  the  141  trustees  who  served  on  ffrdc  boards  during  fiscal 
year  1993  showed  that  these  individuals  had  affiliations  with  447  private 
sector  firms,  126  universities,  and  91  federal  government  or  military 
organizations.  Further,  51  of  the  private  sector  firm  affiliations  and  77  of 
the  university  affiliations  were  with  organizations  that  were  among  the  top 
100  prime  contractors  to  dod.  For  example,  one  individual  served  as  a 
trustee  of  two  different  dod  ffrdcs  and  was  affiliated  with  four  private 
sector  firms,  including  one  of  the  nation’s  principal  weapons  producers. 
Another  trustee  was  affiliated  with  two  presidential  advisory  commissions 
addressing  mUitaty  questions  and  with  five  private  sector  firms,  including 
a  mqjor  defense  aerospace  company.  Another  was  a  member  of  the  dsb 
and  was  affiliated  with  two  universities  that  operate  ffrdcs  for  dod  and 
receive  significant  dod  research  funding. 

This  issue  of  interlocking  directorships  received  little  attention  in  the 
studies  of  ffrdc  issues  we  reviewed  that  were  published  durmg  the  1970s 
and  1980s.  In  1991,  Congress  (P.L.  102-172)  prohibited  members  of  ffrdc 
boards  of  trustees  or  directors  fi-om  simultaneously  serving  on  the  board 
of  a  for-profit  dod  contractor  \mless  the  ffrdc  had  a  DOD-approved  conflict 
of  interest  policy  for  board  members,  dod  assigned  responsibility  for 
reviewing  and  approving  conflict  of  interest  policies  for  boards  of  trustees 
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to  FFRDC  sponsors  and  declined  to  estabUsh  DOD-wide  criteria  for 
approving  such  policies.  In  1992,  a  congressional  conunittee  expressed 
doubt  about  the  wisdom  of  dod’s  heavy  reliance  on  sponsors  to  exercise 
oversight  of  ffrdcs  (House  Report  102-627).  The  dod  Inspector  General’s 
1994  report  stated  that  each  of  the  organizations  that  operates  an  ffrdc  for 
DOD  had  conflict  of  interest  policies  for  board  members  that  had  been 
approved  by  primary  sponsors  and  that  all  board  members  had  disclosed 
their  affiliations  as  these  policies  required.  Further,  the  report  found  that 
contracting  officers  for  9  of  the  10  ffhdcs,  however,  were  personally 
unaware  of  the  affiliations  of  ffrdc  trustees. 


DOD  Oversight  of  Its 
FFRDCs 


Questions  have  repeatedly  been  raised  within  Congress  and  among  others 
about  the  adequacy  of  dod’s  policy  guidance  and  oversight.  The 
Professional  Services  Coimcil,  for  example,  has  expressed  concern  that 
sponsors  do  not  adequately  consider  whether  their  ffrdcs  are  still  needed 
or  whether  work  they  plan  to  assign  to  their  ffrdcs  is  appropriate. 
Concerns  have  also  been  raised  by  the  dod  Inspector  General’s  office, 
about  whether  controls  over  ffrdc  costs  are  adequate,  particularly 
concerning  contract  fees  paid  to  ffrdcs  and  compensation  paid  to  their 
employees.  In  each  case,  dod  has  taken  some  steps  to  address  the 
concerns  raised.  The  dsb  Task  Force’s  1995  report  noted  a  significant 
distrust  of  dod’s  use  and  management  of  ffrdcs  and  recommended  the 
establishment  of  an  independent  review  panel  to  address  this  distrust. 


DOD  Efforts  to 
Demonstrate  Need  for 
FFRDCs  Have  Been 
Criticized 


Concerns  have  been  raised  by  dod’s  Inspector  General’s  office,  among 
others,  that  dod  does  not  adequately  justify  the  continuing  need  for  an 
FFRDC,  which  determines  whether  to  continue  sponsorship  and 
subsequently  award  noncompetitive  contracts  to  the  organizations  that 
operate  ffrdcs.  The  Federal  Acquisition  Regulation  at  section  35.017-4  (a), 
requires  a  sponsor  to  review  the  continuing  need  for  an  ffrdc  before 
renewing  its  contract  or  agreement.  This  comprehensive  review  must  be 
done  at  least  eveiy  5  years.  -The  Professional  Services  Council  asserts  that 
private  firms  have  a  broad  range  of  research  and  analytical  capabilities 
that  would  allow  them  to  undertake  many  tasks  dod  assigns  to  ffrdcs. 
Further,  according  to  the  Professional  Services  Council,  industry  and  dod 
have  successfully  used  contract  language  to  mitigate  potential  conflicts  of 
interest,  dod  continues  to  rely  on  ffrdcs,  the  Professional  Services  CouncU 
maintains,  because  it  has  not  considered  the  capabilities  of  industry.  In  a 
1993  report,  the  dod  Inspector  General  found  that  the  sponsors  did  not  use 
market  surveys  to  identify  alternatives  to  ffrdcs  during  comprehensive 
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reviews.  The  Injector  General  also  noted  that  sponsors  did  not  publicize 
planned  ffe£DC  contract  renewals  to  invite  industry  to  express  interest  in 
operating  the  ffrdcs  and  explain  its  capability  to  do  so. 

DOD  has  taken  steps  to  ensure  that  sponsors  provide  more  thorough 
documentation  of  their  comprehensive  reviews.  In  response  to 
congressional  concern,  dod  issued  a  1992  ffrdc  management  plan,  which 
directed  sponsors  to  provide  copies  of  review  reports  to  the  Director  of 
Defense  Research  and  Engineering  for  evaluation  and  to  update  reviews 
conducted  before  1990.  dod’s  1994  updated  ffrdc  management  plan 
outlines  the  criteria  that  govemmentwide  policy  requires  sponsors  to 
address  in  comprehensive  reviews.  Under  this  plan,  the  Director  of 
Defense  Research  and  Engineering  must  concur  with  the  sponsor’s 
determination  to  continue  an  ffrdc  before  its  agreement  is  renewed. 
Sponsors  that  we  spoke  with  believe  that  current  comprehensive  review 
guidance  is  adequate,  although  it  lacks  detail  on  how  to  assess  the  criteria 
for  renewing  an  ffrdc’s  sponsoring  agreement.  We  found  that  recently 
completed  comprehensive  reviews  generally  contained  extensive  analyses 
and  discussion  and  addressed  the  required  criteria  but  did  not  include 
formal  market  surveys. 


Appropriateness  of  Work 
Given  to  FFRDCs  Has 
Been  Questioned 


Concerns  have  also  been  expressed  about  whether  sponsors  adequately  ^ 
screen  tasks  assigned  to  ffrdcs.  The  Federal  Acquisition  Regulation  at 
section  35.017-3  requires  sponsors  to  assign  an  ffrdc  only  tasks  that  are 
consistent  with  its  mission  and  scope  of  work.^  The  Professional  Services 
Council,  however,  maintains  that  ffrdcs  often  receive  work  for  which  they 
are  not  uniquely  qualified  because  assigmng  a  task  to  an  ffrdc  is  more 
convenient  than  awarding  a  separate  competitive  contract.  On  the  basis  of 
a  survey  of  229  ffrdc  projects  that  are  discussed  in  its  1994  report,  the  dod 
Inspector  General  also  criticized  task  sponsors  justifications  for 
requesting  ffrdc  support.  Task  sponsors  cited  luuque  ffrdc  expertise  to 
explain  why  an  ffrdc  could  perform  a  task  more  effectively  than 
non-FFRDC  soiu*ces,  but  they  generally  did  not  define  the  characteristics 
that  made  the  ffrdc  more  effective.  Further,  task  sponsors  generally  did 
not  compare  ffrdc  costs  with  the  cost  of  other  sources.  Similarly,  the 
Inspector  General  of  the  Defense  Information  Systems  Agency  found  that 
the  agency  lacked  adequate  internal  controls  over  requests  for  support 
from  the  DOD-sponsored  ffrdc  operated  by  the  MITRE  Corporation. 
According  to  the  Inspector  General,  justifications  that  task  sponsors 


*As  previously  discussed,  DOD  also  includes  consistency  with  the  special  relationship  as  a  criterion  for 
assigning  work  to  the  FFRDCs. 
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provided  included  “boilerplate”  wording  with  no  analysis  to  show  why 
mitre’s  ffrdc  was  the  best  alternative. 

DOD  believes  that  critics  expect  unrealistically  thorough  justification  for 
assigning  tasks  to  an  ffrdc.  dod’s  1994  management  plan  requires  primary 
sponsors  to  review  descriptions  of  work  given  to  ffrdcs  to  ensure  the 
work  is  consistent  with  ffrdc  missions,  dod  relies  on  this  review  by 
primary  sponsors  to  identify  any  inappropriate  requests  for  work  that  task 
sponsors  submit.  Commenting  on  the  dod  Inspector  General’s  report,  the 
Director  of  Defense  Research  and  Engineering  argued  that  the  auditors 
had  applied  extreme  and  unreasonable  standards  to  determine  whether 
FFRDCS  had  unique  qualifications  for  tasks.  Further,  the  Director  noted  that 
the  Inspector  General  had  objected  to  other  reasons  for  assigning  work, 
such  as  an  ffrdc’s  familiarity  with  sponsor  requirements  and  quick 
response  capability.  These  justifications,  the  Director  observed,  are  part  of 
the  core  rationale  for  maintaining  ffrdcs.  The  dsb  Task  Force’s  1995 
report  agreed  that  such  factors  were  important  reasons  for  using  ffrdcs. 
Nonetheless,  dod  has  concluded  that  additional  management  controls  over 
assignment  of  work  to  ffrdcs  were  needed  and  recently  took  steps  to 
identify  the  core  work  of  each  ffrdc  more  clearly. 


Adequacy  of  FFRDC  Audit  On  the  basis  of  a  govemmentwide  review  of  ffrdcs,  a  1992  report  by  the 

Controls  Has  Been  Senate  Governmental  Affairs  Committee  stated  that  required  audits  of 

Criticized  ffrdc  overhead  costs  were  not  being  completed  in  a  timely  manner. 

According  to  the  Committee’s  report,  dcaa  performed  audits  of  ffrdcs 
sponsored  by  dod,  the  National  Aeronautics  and  Space  Administration 
(NASA),  and  the  Nuclear  Regulatory  Commission  several  years  after  the 
fiscal  year  had  ended.  In  addition,  the  Committee  found  that  several  audits 
contained  repetitive  or  significant  audit  exceptions  to  ffrdc  cost  claims 
that  apparently  were  not  resolved  at  the  time  of  the  deficiency,  dcaa 
acknowledged  that  a  substantial  backlog  of  overhead  cost  audits  had 
developed  during  the  late  1980s  and  early  1990s,  but  stated  this  problem 
was  not  unique  to  ffrdcs.  According  to  dcaa  officials,  increasing  demand 
for  more  time-critical  price  proposal  audits  and  a  shortage  of  audit  staff 
led  to  a  DOD-wide  backlog.  By  1996,  dcaa  had  reduced  the  overhead  audit 
backlog  for  ffrdcs. 


Contract  Fees  Have  Long  The  Senate  Governmental  Affairs  Committee’s  report  also  raised  concerns 

Been  Recognized  as  a  about  the  justification  for  ffrdc  contract  fees.  Contract  fees  are 

Problem  Area  discretionary  funds  provided  to  ffrdcs  in  addition  to  reimbursement  for 
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incQEred  costs  and  are  similar  to  profits  commercial  contractors  earn.  In  a 
1969  report,  we  concluded  that  nonprofit  organizations  such  as  ffrdcs 
incur  some  necessary  costs  that  may  not  be  reimbursed  under  the 
procurement  regulations,  and  we  recommended  that  the  Bureau  of  the 
Budget  (now  known  as  the  Office  of  Management  and  Budget  (omb)), 
develop  guidance  that  specifies  the  costs  contracting  officers  should 
provide  that  fees  cover.  As  the  Committee  report  noted,  since 
govemmentwide  guidance  on  fees  had  not  been  prepared,  it  was  difficult 
to  determine  whether  ffrdc  fees  were  adequately  justified.  In  response  to 
the  Committee’s  report,  ofpp,  omb’s  procurement  policy  arm,  agreed  that 
govemmentwide  guidance  on  contract  fees  for  nonprofit  organizations 
was  needed,  ofpp  has  deferred  action  on  developing  such  guidance 
pending  a  review  of  regulatory  changes  that  dod  and  the  Department  of 
Energy  are  currently  developing. 

In  the  absence  of  govemmentwide  guidance,  recurring  questions  have 
been  raised  about  how  ffrdcs  use  their  fees.  In  its  1994  report,  for 
example,  the  dod  Inspector  General  concluded  that  ffrdcs  used 
$43  million  of  the  $46.9  million  in  fiscal  year  1992  dod  fees  for  items  that 
should  not  have  been  funded  from  fees.  The  bulk  of  this  $43  million 
funded  independent  research  projects  that  should  have  been  charged  to 
overhead  rather  than  paid  from  fees.  The  remainder  of  the  $43  million 
funded  unallowable  costs  and  future  requirements  that  the  Inspector 
General  concluded  were  not  necessary  for  ffrdc  operations.  Similarly, 
DCAA  reviewed  fiscal  year  1993  fee  expenditures  at  the  MITRE  Corporation 
and  concluded  that  just  11  percent  of  the  expenditures  reviewed  were 
ordinary  and  necessary  to  the  operation  of  the  ffrdc.  dcaa  reported  that 
MITRE  used  fees  to  pay  for  items  such  as  lavish  entertainment,  personal 
expenses  for  company  officers,  and  generous  employee  benefits.  Our 
recent  work  at  The  Aerospace  Corporation  found  that  the  corporation 
used  about  $11.5  million  of  its  $15.6  million  management  fee  in  fiscal  year 
1993  for  sponsored  research.  Aerospace  used  the  remainder  of  its  fee  and 
other  corporate  resources  for  capital  equipment  purchases;  real  and 
leasehold  property  improvements;  and  other  unreimbursed  expenditures 
such  as  contributions,  personal  use  of  company  cars,  conference  meals, 
trustee  expenses,  and  new  business  development  expenses. 

Federal  agencies  are  attempting  to  address  concerns  about  ffrdc  fees  but 
are  pursuing  different  approaches,  dod  has  concluded  that  contracting 
officers  should  determine  an  ffrdc’s  needs  for  discretionary  funding  and 
base  fee  awards  on  these  needs.  In  particular,  dod  believes  contracting 
officers  need  clear  guidance  on  what  fees  may  appropriately  be  provided 
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to  cover,  dod  has  revised  its  ffrdc  management  plan  to  clarify  procedures 
sponsors  and  contracting  officers  should  follow  in  determining  fees,  nasa, 
in  contrast,  has  revised  its  ffrdc  contract  with  the  Jet  Propulsion 
Laboratory  to  provide  a  performance-based  fee.  nasa  provides  the 
Laboratory  a  base  fee  of  $6  million  annually,  and  the  laboratory  can  earn 
up  to  an  additional  $12  million  in  fees  by  meeting  performance  criteria  in 
its  contract.  The  Department  of  Energy  is  also  revising  its  ffrdc  contracts 
to  incorporate  performance  criteria.  Fee  provisions  in  the  revised 
contracts  differ  somewhat,  but  some  contracts  link  payment  of  fees  to 
meeting  contract  performance  criteria. 


Reasonableness  of  The  proper  benchmark  for  assessing  ffrdc  employees’  compensation. 

Compensation  Has  Been  particularly  executives,  has  long  been  a  problematic  issue.  The  Federal 
Questioned  Acquisition  Regulation  at  section  31.205-6  requires  contractors  to 

demonstrate  that  employee  compensation  is  reasonable  in  comparison  to 
compensation  paid  by  firms  in  the  same  industry,  among  other  tests. 
FFRDCS  generally  use  compensation  at  private  industry  research  firms  as 
the  benchmark  for  their  compensation.  As  early  as  1962,  however,  the  Bell 
Report  asked  whether  a  corporation  similar  to  an  ffrdc — created  to 
provide  services  to  the  government  and  receiving  all  its  financial  support 
from  the  government — could  be  considered  a  “private”  firm.  The  report 
concluded  that  private  industry  was  generally  the  proper  benchmark  for 
setting  pay  at  such  organizations,  but  it  noted  that  the  salaries  of  top 
management  merited  special  attention.  In  1969,  Congress  imposed  a  cap 
on  salaries  for  ffrdc  personnel  that  lasted  for  several  years.®  In  1994, 
Congress  imposed  a  cap  on  ffrdc  executive  compensation,  equal  to  level  I 
of  the  federal  Executive  Schedule,  that  became  effective  on  July  1, 1995 
(P.L.  103-335).  Congress  has  not  passed  legislation  to  impose  this  cap 
through  fiscal  year  1996. 

The  conclusions  that  may  be  drawn  fi-om  recent  ffrdc  employee 
compensation  reviews  depend  on  whether  private  industry  or  civil  service 
pay  scales  are  selected  as  the  benchmark.  The  dod  Inspector  General,  for 
example,  recently  reported  that  salaries  for  ffrdc  chief  executives  were 
generally  comparable  to  private  industry  chief  executive  salaries  but 
uniformly  well  in  excess  of  the  highest  civil  service  salaries.  Salaries  for 
other  ffrdc  executives  were  generally  somewhat  less  than  salaries  for 
other  private  industry  executives  but  generally  exceeded  civil  service 
salaries.  The  Inspector  General  also  reported  indications  that  salaries  for 
scientists  and  engineers  were  higher  than  salaries  in  leading  research  and 


®The  Armed  Forces  Appropriations,  authorization  Act,  1970,  P.L.  91-121. 
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development  atganizations.  A  dcaa  audit  of  compensation  levels  at  MITRE 
found  similar  conditions.  Our  recent  work  on  executive  compensation  at 
The  Aerospace  Corporation  found  that  salary  costs  for  executives 
increased#y  78  percent  over  the  3-year  period  ending  September  1994. 
This  increase  resulted  from  salary  increases  of  up  to  29  percent  for 
individual  executives  during  1992  and  a  45-percent  increase  in  the  number 
of  executives  from  22  to  32.  During  that  time,  average  annual  executive 
salaries  increased  by  23  percent  from  $125,000  to  about  $153,000.  In 
addition,  we  recently  issued  a  report  on  ffrdc  compensation  in  relation  to 
federal  compensation  levels,  which  found  that  the  average  compensation 
for  all  fiscal  year  1993  ffrdc  employees  in  the  study  was  $89,000. 

DOD  believes  employee  compensation  at  its  ffrdcs  is  generally  reasonable 
and  accepts  private  industry  pay  scales  as  the  relevant  benchmark.  In  its 
1995  report,  the  dsb  Task  Force  noted  that  flexible  policies  with  respect  to 
employee  pay  and  benefits  is  one  private  sector  characteristic  that  makes 
FFRDCS  attractive  to  dod.  The  Task  Force  also  warned  that  mandated  salary 
limits  would  lead  to  a  deterioration  in  the  quality  of  ffrdc  employees,  dcaa 
has  identified  instances  in  which  it  believes  pay  for  certain  classes  of 
FFRDC  employees  is  excessive — compared  with  pay  for  comparable  private 
industry  employees — ^and  dod  contracting  officers  have  acted  to  resolve 
these  cases,  dod  also  commissioned  a  compensation  consulting  firm  to 
review  compensation  for  staff  that  would  have  been  subject  to  the  fiscal 
year  1995  salary  cap.  On  the  basis  of  this  review,  dod  concluded  that  the 
staffs  compensation  was  reasonable  and  should  not  be  restricted  by 
mandatory  limits. 


Independent  Review  Panel 
Has  Been  Created  to 
Advise  on  FFRDCs 


Although  it  endorsed  the  need  for  organizations  such  as  ffrdcs,  the  dsb 
Task  Force  stated  in  its  report  that  significant  mistrust  existed  concerning 
dod’s  use  and  oversight  of  ffrdcs.  A  principal  concern,  according  to  the 
Task  Force,  was  that  dod  assigned  work  to  ffrdcs  that  could  have  been 
performed  as  effectively  by  private  industry  sources  and  acquired  using 
competitive  procurement  procedures.  Further,  the  Task  Force  found  that 
the  lack  of  opportunities  for  public  review  and  comment  on  dod’s  process 
for  managing  and  assigning  work  to  ffrdcs — available  in  the  competitive 
contracting  process — invited  mistrust.  To  address  public  skepticism  about 
dod’s  use  and  management  of  ffrdcs,  the  Task  Force  recommended 
creation  of  an  independent  review  panel  of  highly  respected  personnel 
from  outside  dod.  The  panel  would  review  the  continuing  need  for  ffrdcs, 
FFRDC  missions,  and  dod’s  management  and  oversight  mechanisms  for 
ffrdcs. 
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Alternatives  to  Using 
FFRDCs 

Concerns  have  long  been  expressed  by  the  Professional  Services  Council, 
among  others,  that  dod  does  not  adequately  consider  hiring  civil  servants 
or  contracting  with  commercial  firms  as  alternatives  to  using  ffrdcs.  Even 
though  DOD  maintains  that  in-house  and  contractor  alternatives  to  the 
centers  are  not  as  effective,  limits  on  hiring  additional  civil  servants  make 
in-house  alternatives  difficult  to  pursue  and  the  complexity  of  awarding 
competitive  contracts  to  commercial  firms  has  been  mentioned  as  an 
incentive  for  using  ffrdcs.  These  factors  may  hamper  dod’s  efforts  to 
reduce  dependance  on  ffrdcs  but  need  not  exclude  consideration  of 
alternatives. 

Shrinking  Fedoral  Limits  on  the  size  of  the  federal  workforce  impede  efforts  to  hire  civil 

Workforce  Complicates  servants  to  perform  work  contracted  out  to  ffrdcs.  In  analyzing  the 

Transferring  FFRDC  Work  feasibility  of  alternatives  to  FFRDCS,  several  sponsors  have  noted  that 

personnel  ceilings  would  prevent  acquiring  in-house  resources  to 
accomplish  ffrdc  functions.  Similarly,  the  dsb  Task  Force  concluded  in  its 
1995  report  that  it  was  not  feasible  to  replace  ffrdcs  with  in-house 
resources  because  the  dod  workforce  was  expected  to  shrink  rather  than 
expand  in  coming  years.  Thus,  sponsors  seeking  to  replace  ffrdc 
capabilities  must  compete  for  a  shrinking  pool  of  authorized  civil  service 
positions. 

We  have  previously  expressed  concern  that  personnel  ceilings  may  lead 
agencies  to  contract  out  work  when  it  is  not  desirable  to  do  so.  For 
example,  our  1991  report  stated  a  conunon  perception  among  agency 
managers  that  contract  dollars  were  easier  to  obtain  than  authorizations 
for  additional  staff.  As  a  result,  we  noted  instances  in  which  it  was  unclear 
whether  agencies  had  contracted  out  work  that  might  have  involved 
inherently  governmental  functions  and  that  might  have  been  less 
e3q)ensive  if  it  had  been  done  in-house.  In  the  report,  we  suggested  that 
Congress  consider  exploring  vdth  omb  allowing  civilian  agencies  to 
manage  their  activities  within  an  authorized  budget  without  regard  to 
persoimel  ceilings.  In  1994,  we  stated  that  before  an  agency  decides 
whether  to  contract  out  for  a  particular  service,  the  agency  should  be 
aware  of  the  comparative  cost  of  contracting  out  versus  using  federal 
employees.  Because  dod  foresees  no  realistic  opportunity  to  hire 
additional  civil  service  staff  in  lieu  of  contracting  with  ffrdcs,  dod’s 
reviews  of  the  continuing  need  for  ffrdcs  do  not  include  such  analyses. 

An  Air  Force  initiative,  known  as  Coral  Convert,  illustrates  the  potential 
benefits  of  performing  such  analyses.  During  1991,  the  Air  Force  Materiel 
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Command  (afbic)  proposed  to  hire  civil  servants  to  replace  certain 
contractorpersormel  at  its  Electronic  Systems  Center  and  Space  and 
Missile  Systons  Center,  afmc  estimated  that  hiring  in-house  personnel  to 
replace  500  ffrdc  and  support  service  contractor  personnel  would  save 
$17.9  million  annually.  In  addition  to  savings,  the  proposal  was  expected 
to  improve  management  control  over  the  acquisition  workforce  and 
provide  flexibility  to  select  the  best  mix  of  government  and  contractor 
personnel.  In  a  limited  test  of  this  proposal,  the  Electronic  Systems  Center 
successfully  recruited  qualified  personnel  for  civil  service  positions.  At 
one  location,  for  example,  3,300  applicants  responded  to  a  newspaper 
advertisement  for  167  positions.  According  to  Air  Force  officials,  the 
personnel  hired  in  this  test  are  performing  effectively,  and  cost  savings  are 
being  achieved.  The  test  was  not  expanded,  however,  due  to  federal 
workforce  reductions  imposed  after  the  National  Performance  Review 
report. 

The  Defense  Authorization  Act,  Fiscal  Year  1996,  Public  Law  104-106, 
complicates  the  picture  dod  faces  as  it  assesses  the  right  mix  of  in-house 
and  contracted  ffrdc  resources.  One  measure  requires  dod  to  consider  the 
efficiencies  gained  through  acquisition  process  streamlining  in  developing 
a  plan  to  reduce  its  acquisition  workforce  by  25  percent  over  5  years. 
Another  measure  requires  dod  to  develop  a  plan  to  consolidate  and  reduce 
the  size  of  its  ffrdcs.  Certain  dod  ffrdcs — ^most  notably  the  Air  Force’s 
two  systems  engineering  ffrdcs — ^provide  needed  support  to  dod’s 
acquisition  workforce. 


Simplified  Procedures  for 
Procuring  Services  Are 
Now  Available 


Federal  procurement  procedures  are  one  motivation  for  using  ffrdcs.  The 
Professional  Services  Council  asserts  that  dod  program  managers 
frequently  place  work  with  ffrdcs  to  avoid  the  administrative  burdens  of 
competitive  contracting,  dod  maintains  that  ffrdc  staff,  due  to  their 
extensive  background  with  sponsors’  programs,  have  a  unique  ability  to 
respond  to  high-priority,  time-sensitive  analytical  requirements,  dod 
acknowledges  that  procuring  services  competitively  can  be  burdensome 
and  time-consuming,  but  maintains  that  convenience  in  obtaining  services 
is  not  a  motivation  for  using  ffrdcs.  In  its  1994  survey  of  229  ffrdc 
projects,  however,  the  dod  Inspector  General  fovmd  liiat  about  30  percent 
of  task  sponsors  reported  that  ease  and  quickness  of  obtaining  services 
influenced  their  decision  to  seek  ffrdc  support. 


While  some  task  sponsors  may  perceive  ffrdcs  to  be  attractive  because 
obtaining  services  appears  quick  and  easy,  two  alternatives  could  alleviate 
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administrative  burdens.  In  our  1988  report,  we  recommended  that  dod  test 
using  broad  agency  annormcements  to  obtain  information  on  the 
capabilities  of  non-FFRDCs — ^including  commercial  contractors — ^to 
participate  in  pursuing  dod’s  research  goals.  We  concluded  that  the 
procedures  associated  with  such  announcements  could  be  a  relatively 
informal  and  expeditious  way  to  solicit  industry  proposals  in  support  of 
agency  research  plans.  More  recently,  in  its  1994  report,  the  dod  Inspector 
General  endorsed  broad  agency  announcements  as  a  tool  for  gathering 
information  on  alternatives  to  ffrdcs. 

The  task  order  contracting  procedure  for  advisory  and  assistance  services 
authorized  imder  the  Federal  Acquisition  Streamlining  Act  of  1994,  Public 
Law  103-355,  which  was  revised  from  previous  procedures,  is  another 
mechanism  that  could  be  useful.  Task  order  contracts  provide  for  the 
government  to  issue  orders  to  perform  defined  tasks  during  the  contract 
term  but  do  not  commit  the  government  to  purchase  more  than  a 
minimum  quantity  of  services;  services  are  purchased  by  placing  task 
orders  vmder  the  contract.  Congress  was  concerned  that,  rmder  the 
previous  procedures,  such  contracts  could  be  abused  to  avoid  competition 
(Senate  Report  103-258,  S.1587, 103  Cong.  2d  Sess.  15  (1994)).  Under  the 
new  procedures,  when  an  agency  plans  to  award  a  task  order  contract  for 
advisory  and  assistance  services  to  exceed  3  years  and  valued  at  over 
$10  million,  it  must  provide  for  awards  to  multiple  contractors  under  a 
single  solicitation.  When  placing  mdividual  task  orders  under  such 
contracts,  the  agency  does  not  need  to  conduct  formal  competitions; 
however,  it  must  provide  all  contractors  awarded  contracts  under  the 
soliticitation  a  fair  opportunity  to  be  considered  for  the  order.  Congress 
intended  to  give  agencies  broad  discretion  in  establishing  procedures  for 
the  evaluation  and  award  of  orders  under  such  contracts  (Senate  Report 
103-258,  id.). 

Experience  gained  through  a  planned  Air  Force  initiative  could  shed  light 
on  how  well  these  procedures  work  and  on  how  effectively  private 
contractors  can  perform  ffrdc  work.  The  Air  Force  plans  to  contract 
competitively  for  certain  core  functions  its  systems  engineering  ffrdcs 
currently  perform  and  has  ranked  these  functions  to  identify  those  most 
suitable  for  competitive  contracting.  The  Electronic  Systems  Center,  for 
example,  considers  laboratory  testing  to  explore  or  verify  performance 
most  suitable  for  competitive  contracting  with  a  non-FFRDC  because 
following  an  established  test  protocol  and  reporting  results  involve  little 
exercise  of  discretion  or  judgment.  In  contrast,  developing  and  analyzing 
systems  architectures  requires  the  exercise  of  considerable  discretion  and 
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judgment,  <as  weD  as  a  broad  knowledge  of  Air  Force  systems; 
consequently,  the  Electronic  Systems  Center  does  not  consider  this 
function  smtable  for  competitive  contracting.  The  Air  Force  will  not  start 
this  test  iffitil  decisions  are  made  on  plans  to  streamline  its  acquisition 
process;  some  functions  its  systems  engineering  ffrdcs  currently  perform 
may  be  cmtailed  or  eliminated. 


DOD  Actions  to 
Improve  FFRDC 
Management 


Under  an  action  plan  submitted  to  Congress  in  1995,  dod  has  begun  steps 
to  strengthen  management  of  its  ffrdcs  and  address  some  of  the  issues  we 
identified.  In  February  1996,  dod  updated  the  status  of  four  key  action  plan 
initiatives,  including  (1)  defining  core  work  appropriate  for  ffrdcs; 

(2)  establishing  criteria  for  acceptance  of  work  outside  the  core  by  ffrdcs’ 
parent  companies;  (3)  developing  guidance  to  ensure  that  management 
fees  provided  to  ffrdcs  are  based  on  need  and  detailed  justification;  and 
(4)  establishing  an  independent  advisory  panel  to  review  dod’s 
management,  use,  and  oversight  of  its  ffrdcs.  As  stated  in  our  March  1996 
testimony,  we  believe  these  initiatives  will  move  dod’s  management  of 
FFRDCS  in  a  positive  direction.  Because  the  initiatives  are  just  now  being 
implemented,  it  is  too  early  to  tell  how  effectively  they  will  be 
implemented  or  how  well  they  will  address  long-standing  concerns 
regarding  use  of  ffrdcs. 

First,  DOD  has  adopted  criteria  for  identifying  an  ffrdc’s  core  work  effort, 
defined  as  work  that  (1)  is  consistent  with  the  ffrdc’s  purpose,  mission, 
capabilities,  and  core  competencies  and  (2)  requires  a  special  relationship 
to  exist  between  the  ffrdc  and  its  sponsor,  dod  directed  sponsors  to 
review  the  workload  of  their  ffrdcs  and  identify  work  that  should  be 
transitioned  out  of  the  ffrdc  and  acquired  competitively.  According  to  the 
Under  Secretary  of  Defense  (Acquisition  and  Technology),  sponsors  had 
identified  about  $43  million  in  noncore  work  being  performed  at  the 
ffrdcs;  this  represents  about  4  percent  of  the  planned  $1.2  billion  in  fiscal 
year  1996  funding.  This  noncore  work  is  currently  being  transferred  out  of 
the  FFRDCS.  While  the  core  work  criteria  seek  to  clarify  what  tasks  are 
appropriate  for  an  ffrdc,  the  need  for  a  task  to  be  performed  by  an 
organization  having  a  strategic  relationship  with  the  sponsor  is  a  key 
element  of  the  criteria.  Thus,  applying  the  criteria  requires  making 
judgments  about  the  relative  effectiveness  of  various  sources  for  work  in 
the  absence  of  full  information  on  capabilities,  which  open  competition 
would  provide.  Sponsors’  implementation  of  the  dod  criteria,  therefore, 
may  eventually  prove  unsatisfactory  to  critics  who  seek  a  simple  and 
unambiguous  definition  of  work  appropriate  for  the  ffrdcs. 
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DOD  has  revised  its  ffrdc  management  plan  to  incorporate  guidelines  on 
diversification  by  ffrdc  parent  corporations  into  non-FFRDC  work.  The 
guidelines  provide  that  parent  corporations  may  accept  non-FFRDC  work 
subject  to  sponsor  review  for  compliance  with  criteria  that  requires  that 
the  work,  among  other  things,  (1)  is  in  the  national  interest,  (2)  does  not 
detract  from  performance  of  ffrdc  work,  and  (3)  does  not  give  rise  to  real 
or  perceived  conflicts  of  interest.  The  management  plan  does  not  provide 
for  DOD-level  officials  to  review  or  approve  such  work,  but  provides 
sponsors  the  opportunity  to  exercise  greater  control  over  the  non-FFRDC 
work  parent  corporations  undertake.  The  plan’s  ultimate  effectiveness  in 
alleviating  concerns  about  parent  corporations’  diversification  will  depend 
on  the  quality  and  thoroughness  of  sponsor  reviews  of  proposed  non-FFRDC 
work. 

dod’s  revised  management  plan  also  clarifies  that  contracting  officers  must 
consider  demonstrated  needs  in  determining  management  fees  and 
incorporates  guidelines  defirung  legitimate  needs.  'The  plan’s  guidelines 
(1)  move  allowable  costs  out  of  fee  and  (2)  establish  consistent  policies  on 
providing  fees  to  cover  costs  not  reimbursable  xmder  the  contract  that  the 
FFRDC  can  demonstrate  are  needed  for  its  successful  operation.  If 
effectively  implemented,  these  actions  should  help  to  resolve  many  of  the 
long-standing  concerns  over  ffrdc  use  of  management  fees.  Since  much  of 
fee  is  used  for  normally  allowable  independent  research  costs,  moving 
independent  research  out  of  fee  will  substantially  reduce  fee  and  subject 
these  research  costs  to  review  and  oversight  with  appropriate  principles 
for  determining  costs  xmder  contracts  with  educational  institutions  or 
nonprofit  organizations.  Defining  ordinary  and  necessary — ^but 
imallowable — business  expenses,  which  may  be  covered  by  fee,  remains  a 
more  challenging  issue,  dod’s  management  plan  does  not  provide 
examples  of  ordinary  and  necessary  expenses  that  fee  may  properly  be 
provided  to  cover.  Consequently,  we  believe  debate  will  continue  on 
whether  fee  can  be  used  for  such  items  as  personal  expenses  for  company 
officers,  entertainment,  and  new  business  development. 

Finally,  the  advisory  panel  the  dsb  Task  Force  recommended  has  been 
established.  In  late  1995,  six  individuals — ^who  are  either  dsb  members  or 
consultants — were  appointed  to  the  panel,  which  has  been  constituted  as  a 
task  force  of  the  dsb.  The  panel’s  charter  calls  for  the  members  to  review 
and  advise  dod  on  the  management  of  ffrdcs  by 

•  reviewing  guidelines  for  the  appropriate  scope  of  work,  customers, 
organizational  structure,  and  size  of  the  ffrdcs; 
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•  overseeing  cconpliance  with  dod’s  ffrdc  management  plan; 

•  reviewing^sponsors’  management  of  ffbdcs; 

•  reviewing  the  level  and  appropriateness  of  non-DOD  and  nonsponsor  work 
performediby  the  ffrdcs; 

•  ovemeeing’the  comprehensive  review  process;  and 

•  performing  selected  ffrdc  program  reviews. 

In  January  1996,  the  panel  began  a  series  of  fact-finding  meetings  at  the 
FFRDCS,  which  were  attended  by  dod  sponsor  personnel  and  ffrdc  officials. 
Representatives  of  our  office  attended  the  panel’s  initial  fact-finding 
meetings  and  observed  that  the  members  appeared  to  approach  their  task 
with  the  utmost  seriousness  and  challenged  the  conventional  wisdom  by 
asking  tough  questions  of  both  dod  and  ffrdc  officials,  dod  anticipates  that 
the  panel  will  submit  its  first  report  in  the  summer  of  1996. 
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Government-Sponsored  Nonprofit  Contractors  (B-146810,  Feb.  10, 1969). 

Report  to  the  President  on  Government  Contracting  for  Research  and 
Development  (U.S.  Senate,  87th  Congress,  2nd  Session,  Document  No.  94, 
May  17, 1962).  This  report,  prepared  by  a  presidentially  appointed 
committee  led  by  Bureau  of  the  Budget  Director  David  Bell,  is  commonly 
referred  to  as  “The  BeU  Report.” 
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Information  on  DOD’s  FFRDCs 


DOD  current^  qwnsors  11  ffrdcs  operated  by  8  parent  organizations. 
Table  111.1  provides  information  on  each  ffrdc,  including  the  parent 
organizatkai,  primary  sponsor,  dod  funding,  and  members  of  technical 
staff  (mts)^  provided  for  fiscal  year  1995. 


Table  III.1:  Information  on  DOD’s  FFRDCs  (fiscal  year  1995) 

Dollars  in  millions 

FFRDC 

Parent  organization 

Primary  sponsor 

Obligations 

MTS 

Systems  engineering  and  integration  centers 

Aerospace 

The  Aerospace  Corporation 

Air  Force 

$335 

1,910 

MITRE  C3| 

MITRE  Corporation 

Assistant  Secretary  of  Defense  (C^l) 

374 

2,109 

Subtotal 

$709 

4,019 

Studies  and  analyses  centers 

Arroyo  Center 

RAND 

Army 

20 

99 

Project  AIR  FORCE 

RAND 

Air  Force 

24 

112 

National  Defense  Research 
Institute 

RAND 

OSD 

19 

105 

Center  for  Naval  Analyses 

The  CNA  Corporation 

Navy 

47 

238 

IDA — Studies  and 
Analyses/Operational 

Test  and  Evaluation  Center 

IDA 

OSD 

68 

372 

Logistics  Management 
Institute 

Logistics  Management 
Institute 

OSD 

29 

166 

Subtotal 

$207 

1,092 

Research  and  development  laboratories 

Lincoln  Laboratory 

Massachusetts  Institute  of 
Technology 

Air  Force 

275 

1,017 

Software  Engineering 
Institute 

Carnegie-Mellon  University 

Defense  Advanced  Research  Projects 
Agency 

29 

170 

IDA — Communications  and 
Computing 

IDA 

National  Security  Agency 

33 

142 

Subtotal 

$386 

1,329 

Total 

$1,253 

6,440 

Note:  C^l,  command,  control,  communication,  and  intelligence;  OSD,  Office  of  the  Secretary  of 
Defense;  and  IDA,  Institute  for  Defense  Analyses. 


Source:  OSD. 


^MTS  include  the  direct  professional  labor  of  scientists,  engineers,  researchers,  mathematicians, 
analysts,  economists,  and  others  who  perform  professional-level  technical  work.  MTS  is  defined  as 
1,810  hours  of  full-time  professional  effort;  MTS  does  not  include  subcontracted  effort. 


Page  36 


GAO/NSlAD'96-112  Federally  Funded  R&D  Centers 


Appendix  IV 


Comparison  of  FFRDCs’  Former  Scope  of 
Work  Descriptions  and  Core  Competencies 

FFRDC 

Scope  of  work 

Core  competencies 

Aerospace 

•  Advanced  systems  architecture:  concept  analysis 
and  planning;  research,  development,  test,  and 
evaluation;  experimentation;  and  systems  engineering 
and  integration. 

•  Mission-oriented  investigation  and  experimentation. 

•  Multiprogram  systems  engineering. 

•  Foreign  technology  support. 

•  Technical  support,  recommendations,  and  reviews. 

•  Technical  analysis,  support,  evaluation,  and  review 
in  the  field  of  U.S.  national  security  space  systems. 

•  Long-range  planning,  systems  analysis,  and 
comparison  studies,  including  technical  risk 
management,  cost,  and  schedule  assessments. 

•  Launch  certification. 

•  Systems  of  systems  engineering. 

•  Systemt  development  and  acquisition. 

•  Process  implementation. 

•  Technology  application. 

MITRE  C3| 

•  Systems  research  and  planning. 

•  System  design. 

•  Technical  management. 

•  Selected  fields  of  research  and  experimentation, 
including  navigation,  detection,  surveillance, 
identification,  threat  evaluations,  warning,  weather, 
and  intelligence. 

•  Systems  of  systems  engineering. 

•  Systems  development  and  acquisition. 

•  Process  implementation. 

•  Technology  application. 

•  Architectures  and  interoperability. 

Arroyo  Center 

•  Geopolitical  environment  and  its  effects  on  the  Army. 

•  Implications  of  the  external  threat  environment. 

•  Research  in  strategy,  military  planning,  and  regional 
security. 

•  Restructuring  initiatives  designed  to  make  the  Army 
more  efficient. 

•  Alternative  technology  applications  and  technical 
strategies. 

•  Force  composition,  size,  and  operational  concepts. 

•  Interactive  modeling  and  simulation  capability. 

•  Initiatives  and  designs  for  the  Army  of  the  future. 

•  Logistics,  sustainment,  and  redesign  initiatives. 

•  Force  development  and  technology. 

•  Personnel  and  training. 

•  Military  logistics. 

•  Strategy  and  doctrine. 

Project  AIR  FORCE 

•  Strategy,  doctrine,  and  force  structure. 

•  Force  modernization  and  employment. 

•  Resource  management  and  systems  acquisition. 

•  Strategy  and  doctrine. 

•  Force  development  and  application. 

•  Resource  management. 

National  Defense 
Research  Institute 

•  Research,  studies,  and  analyses  in  areas  such  as 
international  security  and  defense  strategy, 
acquisition  and  technology  policy,  and  forces  and 
resources  policy. 

•  International  policy  and  defense  strategy. 

•  Forces  and  resources  policy. 

•  Technology  and  acquisition  policy. 

•  Research  integration. 

(continued) 
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Comparison  of  FFRDCs’  Former  Scope  of 
Work  Descriptions  and  Core  Competencies 


FFRDC 

Scope  of  work  ^ 

Core  competencies 

Center  for  Naval 
Analyses 

•  Geopolitical  security  environniefit. 

•  Roles,  missions,  and  concept^, of  operations. 

•  Force  planning  and  evaluation,. 

•  System  requirements.  ' 

•  Fleet  tactics  and  capabilities. 

•  Joint  space  and  electronic  warfare/command, 
control,  communication,  computers,  intelligence,  and 
information. 

•  Cost  and  operational  effectiveness  analysis. 

•  Research,  development,  and  acquisition. 

•  Infrastructure. 

•  Personnel. 

•  Medical. 

•  Training. 

•  Readiness,  maintenance,  and  logistics. 

•  Modeling  and  simulation. 

•  Operations  analysis. 

•  System  requirements  and  acquisition. 

•  Resource  analysis. 

•  Program  planning. 

•  Policy,  strategy,  and  doctrine. 

IDA-Studies  and 
Anaiyses/Operational 
Test  and  Evaluation 
Center 

•  Alternative  technology  applications  and  technical 
strategies. 

•  Applications  of  advanced  computing  and 
information  systems. 

•  Evaluations  of  systems  proposed  for  prototyping, 
development,  and  procurement. 

•  Assessment  of  test  and  evaluation  plans  and  results. 

•  Exploitation  of  distributed,  interactive  simulation. 

•  Force  composition,  size,  and  operational  concepts. 

•  Costs  of  defense  programs,  forces,  and  supporting 
infrastructure  as  well  as  analyses  of  acquisition 
procedures  and  methods. 

•  Research  in  strategy — military  planning,  regional 
security,  and  related  defense  policy  and  management. 

•  Evaluations  of  the  readiness  and  performance  of 
systems,  forces,  and  military  organizations,  including 
training  and  support  issues. 

•  Implications  of  dual-use  and  international 
technology. 

•  Joint  and  allied  interoperability  standards. 

•  Systems  evaluations. 

•  Technology  assessments. 

•  Force  and  strategy  assessments. 

•  Resource  and  support  analyses. 

Logistics  Management 
Institute 

•  Broad  range  of  policy,  managerial,  and 
technological  issues  in  acquisition,  logistics,  and 
force  management. 

•  Materiel  management. 

•  Acquisition. 

•  Operational  logistics. 

•  Facilities  and  environment. 

•  Force  management. 

Lincoln  Laboratory 

•  Ballistic  missile  defense. 

•  Communications. 

•  Space  surveillance. 

•  Air  defense. 

•  Surface  surveillance. 

•  Advanced  electronics  technology. 

•  Ballistic  missile  defense. 

•  Communications. 

•  Space  surveillance. 

•  Air  defense. 

•  Surface  surveillance. 

•  Advanced  electronics  technology. 

Software  Engineering 
Institute 

•  Technology  transition. 

•  Software  engineering  and  supporting  software 
technology. 

•  Technology  transition. 

(continued) 
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Comparison  of  FFRDCs’  Former  Scope  of 

Work  Descriptions  and  Core  Competencies 

FFRDC 

Scope  of  work 

Core  competencies 

IDA-Communications 

•  Long-term  research  on  mission-critical  problems 

•  Cryptologic  mathematics. 

and  Computing 

confronting  the  sponsor. 

•  Computing  sciences. 

•  Difficult  operational  problems  of  immediate 
importance  associated  with  cryptomathematics  and 
cryptocomputing. 

•  Basic  communications  theory. 
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Comments  From  the  Department  of  Defense 


DIRECTOR  OF  DEFENSE  RESEARCH  AND  ENGINEERING 
3030  DEFENSE  PENTAGON 
WASHINGTON.  D.C.  20301*3030 

2  7  JUN  W 

Mr.  David  E.  Cooper 
Director,  Acquisition  Policy,  Technology, 
and  Competitiveness  Issues 
National  Security  and  International  Affairs  Division 
U.S.  General  Accounting  Office 
Washington  D.C.  20548 

Dear  Mr.  Cooper: 

This  is  the  Department  of  Defense  (DoD)  response  to  the  General  Accounting  Office 
(GAO)  draft  report,  “FEDERALLY  FUNDED  R&D  CENTERS:  Issues  Relating  to  the 
Management  of  DoD-Sponsored  Centers,”  dated  May  30,  1996  (GAO  Code  705084/OSD  Case 
1163). 

The  DoD  generally  concurs  with  the  draft  report  and  is  particularly  encouraged  by  the 
report  language  that  reads:  “As  stated  in  our  March  6,  1996  testimony,  we  believe  these 
initiatives  will  move  DoD's  management  of  FFRDCs  in  a  positive  direction.”  The  Department 
appreciates  the  GAO’s  recognition  of  DoD  efforts  to  improve  management  of  its  Federally 
Funded  Research  and  Development  Centers  (FFRDCs),  However,  while  the  DoD  agrees  it  is  too 
early  to  tell  how  effectively  these  initiatives  will  address  long-standing  concerns  regarding  use  of 
FFI^Cs,  the  Department  is  somewhat  concerned  the  overall  tone  of  the  report  unnecessarily 
speculates  they  may  be  insufficient  to  correct  past  problems. 

Additionally,  there  is  an  issue  that  needs  clarification.  The  DoD  believes  the  report  may 
be  misleading  in  its  brief  discussion  of  the  MITRE  Corporation's  (MITRE)  division.  The  report 
language  suggests  that  DoD  required  MITRE  to  divide  into  two  corporations.  That  is  not  the 
case.  The  decision  was  made  by  MITRE's  Board  of  Trustees  after  DoD  rejected  a  MITRE 
proposal  to  establish  an  affiliated  organization  to  handle  commercial  and  expanded  non-FFRDC 
work.  Upon  notification  by  the  Chairman  of  the  MITRE  Board  of  Trustees  of  its  plan  to  divide 
the  corporation,  DoD  generally  concurred  with  the  direction  of  the  plan  and  formally  expressed 
the  Department's  position  that  any  cost  recovery  and  distribution  of  assets  and  liabilities  be 
legally  appropriate,  justified  and  subject  to  audit  by  the  Defense  Contract  Audit  Agency 
(DCAA). 

Thank  you  for  the  opportunity  to  respond  to  the  draft  report. 
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Major  Contributors  to  This  Report 


National  Security  and 
International  Affairs 
Division,  Washington, 
D.C. 

Boston  Field  Office 


Charles  W.  Thompson 
Erin  Slonaker  Noel 
Maria  Boyreau 


Monty  Peters 


(706084) 
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The  first  copy  of  each  GAO  report  and  testimony  is  free. 
Additional  copies  are  $2  each.  Orders  should  be  sent  to  the 
following  address,  accompanied  by  a  check  or  money  order 
made  out  to  the  Superintendent  of  Documents,  when 
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Orders  for  100  or  more  copies  to  be  mailed  to  a  single  address 
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U.S.  General  Accounting  Office 
P.O.  Box  6015 

Gaithersburg,  MD  20884-6015 
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Room  1100 

700  4th  St.  NW  (corner  of  4th  and  G  Sts.  NW) 

U.S.  General  Accounting  Office 
Washington,  DC 
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or  by  using  fax  number  (301)  258-4066,  or  TDD  (301)  413-0006. 
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